Power law scaling for the adiabatic algorithm for search engine ranking 
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An important method for search engine result ranking works by finding the principal eigenvector of 
the "Google matrix." Recently, a quantum algorithm for preparing this eigenvector and evidence of 
an exponential speedup for some scale- free networks were presented. Here, we show that the run-time 
depends on features of the graphs other than the degree distribution, and can be altered sufficiently 
to rule out a general exponential speedup. For a sample of graphs with degree distributions that more 
closely resemble the Web than in previous work, the proposed algorithm for eigenvector preparation 
does not appear to run exponentially faster than the classical case. 
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Introduction. — Quantum algorithms, which run on 
quantum computers, are known to be able to outperform 
classical algorithms for certain computational problems 
[TJ [2]. Thus, finding a new algorithm that exhibits a 
quantum speedup, in particular an exponential speedup, 
is of great interest [3]. An extremely important prob- 
lem in computer science is calculating ranking for search 
engine results. PageRank, first proposed by Brin and 
Page [4 underlies the success of the Google search en- 
gine [5 . In this algorithm, websites are represented as 
nodes on a network graph, connected by directed edges 
that represent links. The matrix of network connections 
is constructed, and the PageRank vector is its principal 
eigenvector. Currently, computing the PageRank vector 
requires a time O(n), where n is the number of websites 
in the network considered (e.g. the World Wide Web) [6]. 
Obtaining a quantum algorithm for PageRank that runs 
exponentially faster than the classical algorithm would 
be of great interest. 

Recently, Garnerone, Zanardi, and Lidar (GZL) pro- 
posed an adiabatic quantum algorithm [7 to prepare the 
PageRank vector for a given network [6]. Remarkably, 
GZL present evidence that this algorithm can prepare the 
PageRank vector in time O [polylog(n)], exponentially 
faster than classical algorithms for certain networks. This 
runtime is due to the apparent logarithmic scaling of the 
gap between the two smallest eigenvalues of the Hamilto- 
nian used in the algorithm (the energy gap). This scaling 
emerged on graphs constructed using adapted versions 
of two established methods of network construction: the 
preferential attachment model [8] and the copying model 
[9]. Both of these models yield graphs that are similar 
to the connectivity of the World Wide Web in that they 
are sparse (the total number of edges scales at most pro- 
portionally to the number of nodes) and scale-free (the 
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probability of finding a node with a specified in- or out- 
degree scales as a power law in those degrees). These 
features lead to networks that exhibit large-scale struc- 
ture similar to that of the internet, such as being small- 
world [10] and loosely hierarchical [11]. GZL studied sets 
of networks that exhibited both logarithmic scaling and 
polynomial scaling of the gap in the system size. How- 
ever, they did not demonstrate that the networks with 
the favorable logarithmic gap scaling are scale-free over 
the region studied numerically. 

Here, we study the scaling of the GZL algorithm for 
graphs with degree distributions consistent with the in- 
ternet. A realistic network model of the World Wide 
Web must be scale-free in both the in- and the out- 
degree jT2j [15]. We consider a broad variety of scale- 
free networks constructed by different methods. Choos- 
ing three well-known models for constructing random, 
scale- free networks, we control for both the mean degree 
and the exponent of the power-law governing the degree 
distribution. We find that graphs with the same degree 
distribution can have different energy gap and run-time 
behaviors. Finally, we focus on degree distributions de- 
scribed by power laws consistent with those measured 
for the Web, both for the in-degree and the out-degree. 
We find that the relevant energy gap scales as a power 
of the system size, rather than logarithmically. These re- 
sults demonstrate that for Web-like graphs, the GZL adi- 
abatic algorithm does not yield an exponential quantum 
speedup for preparing the PageRank vector compared to 
current classical algorithms. 

Network growth models. — We generate samples of 
graphs with prescribed degree distributions using three 
different network growth models. GZL [6 use modi- 
fied versions of two network construction algorithms: the 
preferential attachment model [8 and the copying model 
[9]. In addition to these two models, here we include 
also the more complex a-preferential attachment model 
described by Bollobas et al. JTSJ [13] . All three models 
grow random networks using probabilistic rules at dis- 
crete construction steps, which are detailed in Fig. [I] 

All three of these models produce sparse, scale-free di- 
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Figure 1. (color online) Illustrations of the three network 
generation models used, (a): GZL 6 preferential attachment, 
(b): GZL copying, and (c): a-preferential attachment [121 
[13] . In all three models, a network is constructed by adding 
vertices and edges sequentially, (a): At each time step a new 
vertex i is added with m outgoing edges. The probability 
that one of these edges connects to a node j is proportional 
to the total degree of j. (b): At each time step there are two 
possible actions. With probability (1 — p), the new vertex 
points to all of the same vertices as the "star vertex," which 
is a pre-existing vertex chosen uniformly at random at each 
time step. With probability p, m outgoing edges are added 
to the new vertex, each pointing to vertices chosen uniformly 
at random, (c): There are three possible actions at each 
time step. With probability pi, a new vertex is added with 
a single outgoing edge, pointing to a node j with probability 
proportional to the in-degree of j plus a parameter a. With 
probability p2, a new vertex is added with a single incoming 
edge, pointing from a node j with probability proportional to 
the out-degree of j plus a. With probability (1 — pi — P2), no 
vertex, only an edge, is added. Its ending and starting points 
are determined as in cases 1 and 2, respectively. In all panels, 
the newly-added edges are indicated by dashed lines. 



rected networks, in which the probability of the in-degree 
(the number of incoming edges) and out-degree (the num- 
ber of outgoing edges) of node i being equal to k are each 
proportional to a power law: 



P(di n (i) 
P(d out (i) 



k) 
k) 
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(2) 



where di n (i) and d out (i) are the in- and out-degrees of 
node z, respectively, and the exponents 7^ and 7 on ^ are 
typically between 2 and 4 [8 . The GZL versions [6] of 



the preferential attachment and copying models [8j [14] 
produce networks that are scale-free in the limit of large 
graph size. However, due to the addition procedure de- 
scribed below, the networks are not necessarily scale-free 
for the sizes of graphs studied numerically here and in 
Ref. [6 j. To achieve networks that are scale-free in the 
out-degree, GZL suggest to construct two networks, X 
and Y", independently. X and Y are each generated as in 
Fig. [l] except that for Y the direction of the edges added 
is reversed. The networks can then be added together, 
and the weights and loops discarded [6j [16] . The result- 
ing composite network is scale-free in both in-degree and 
out-degree, provided X and Y have the same number of 
edges per node. (See Supplemental Materials for details 
[T7].) In contrast to Ref. [6], the graphs studied here are 
all constrained in this way. However, the graphs exhibit- 
ing logarithmic scaling in [6 are not [16 , and they do 
not exhibit truly scale-free degree distributions over the 
numerically studied region. On the other hand, the a- 
preferential attachment model (considered here but not 
in [6]) constructs a network which is scale-free in both 
in- and out-degrees without requiring an additional com- 
bination step. As with the GZL preferential attachment 
model, all weights and loops are removed from the final 
a-preferential attachment network. 

The exponents 7^ (Eq. [I]) and 7 on ^ (Eq. 2| of the de- 
gree distribution are model-dependent. In the GZL pref- 
erential attachment model the number of edges added 
at each construction step controls the sparsity, and it 
is always the case that 7^ = 7 on ^ = 3 [8 . Both the 
GZL copying model and ^-preferential attachment allow 
for independently tunable exponents and mean degree. 
(See Appendix |A| for details.) This flexibility enables us 
to create three ensembles of model networks that have 
nearly identical degree distributions for j in = j out = 3. 
Further, the last two models can be set with the expo- 
nents estimated for the World Wide Web [9j [12] , namely 
j in = 2.1 and j out = 2.72 [T5]. 

Algorithm description. — The Google matrix is con- 
structed by taking as input an unweighted, simple net- 
work with n nodes [I], and representing it as an adjacency 
matrix A, where A(i,j) = 1 if a directed edge points from 
node i to node j, and otherwise. From this, one defines 
the matrix P: 




if A(i,j) = l 
ifVj,A(i,j) = 
otherwise 



(3a) 
(3b) 
(3c) 



The matrix P is stochastic because J^ . P(i,j) = 1 for all 
i. P can be thought of as a random walk (i.e. a web- 
surfer), where the walker follows the network with equal 
likelihood of traversing all allowed links. If the walker 
ever reaches a dangling node (a node with d out = 0), 
Eq. 3b implies that it can randomly hop to any vertex 
with equal probability. To prevent the walker from be- 
coming trapped in an isolated portion of the network 
(a sink), the probability (1 — a g ) of moving to a node 
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uniformly at random (including the possibility of stay- 
ing still) is included, where < a g < 1; Google uses 
OL g — 0.85, which we also use here [6]. The Google matrix 
G is defined as the transpose of this resulting transition 
matrix: 

G = a g P T + (l-a g )J, (4) 

where J is the matrix of all ones. The PageRank vector 
p is the unique eigenvector associated with the largest 
eigenvalue of G, which is 1. The runtime of the best 
classical algorithm, which calculates the PageRank vec- 
tor via power iteration, is 0(n) [4j|6]. 

To formulate an adiabatic quantum algorithm, GZL 
construct the Hamiltonian h(G): 

h(G) = (I - G) f (I - G) , (5) 

which is Hermitian, even though G is not. The ground 
state of this Hamiltonian is the normalized PageRank 
vector. The adiabatic algorithm is completely defined 
by the interpolation Hamiltonian H(s) = sh(G) + (1 — 
s)h(G c ), where s £ [0,1], and G c is the Google matrix 
for the complete network (including loops), whose ground 
state is a uniform superposition. The adiabatic theorem 
guarantees that if we initialize our system in the ground 
state of h(G c ) and change s from to 1 sufficiently slowly, 
the system remains in the ground state [7]. Since the 
PageRank vector is the ground state of H(l) = h(G), the 
PageRank vector is obtained when 5 = 1. The required 
slowness is also determined by the adiabatic theorem: 
as long as s(t) is a smooth function of the time t with 
< t < T, the runtime T ~ 5~ b , where b is 0(1) and 
5 is the energy gap between the ground and first excited 
state of H(s), minimized over s [7]. Thus, an exponen- 
tial speedup over the classical case is possible if S~ x is 
0[log(n)], since then T is O [polylog(n)]. 

Numerical results. — To study the scaling of the mini- 
mum energy gap S with the network size n, we compute 
5 for the GZL Hamiltonian H(s), averaging the results 
over many network realizations (typically 1000). Specifi- 
cally, we calculate the minimum value of S over s £ [0, 1] 
using the Nelder-Mead method [18 , where each objective 
function call calculates directly the eigenvalue spectrum 
of H(s). We find that for most, but not all, network 
choices the minimum gap occurs when s = 1. Since H(s) 
is a dense matrix, this process is computationally inten- 
sive. We use the University of Wisconsin-Madison Center 
for High Throughput Computing and Open Science Grid 
to perform the simulations. 

To assess whether the inverse energy gap £ _1 scales 
logarithmically or as a power-law in n, we plot in Fig. [2] 
versus the network size on both log-linear and log- 
log scales, with data for the GZL preferential attach- 
ment, GZL copying, and ^-preferential attachment mod- 
els. The model parameters are tuned (see Appendix |A|) 
so that all three have 7^ n = 7 on ^ = 3 and have an av- 
erage of 2 in- and 2 out-edges per node. Despite having 
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Figure 2. (color online) Comparison of the scaling of the in- 
verse energy gap £ _1 for the GZL [6 preferential attachment 
model (triangles, horizontal hatching), GZL copying model 
(diamonds, upward-sloping hatching), and a-preferential at- 
tachment model [12] (circles, downward- sloping hatching), 
shown on (a): Semilog and (b): Log-Log scales, demonstrat- 
ing that £ _1 is not proportional to log (n) for these mod- 
els. Results are averaged over 1000 random instances for 
n < 8192, and over 500 random instances at n — 8192. The 
fitting lines showed in (a) are 72.2 - In (n) —363 for the copying 
model and 10.1 • ln(n) — 48.8 for the a-preferential attach- 
ment model. In (b), the fits shown are 8.0 -n 0A for the copying 
model and 1.7-n ' 4 for the a-preferential attachment model. If 
we fit the data instead to a power of a logarithm (not shown) , 
we obtain 0.56-ln 2 9 (n) for the copying model and0.18-ln 2 5 (n) 
for the a-preferential attachment model, (c): Histogram of 
the inverse energy gaps for the data shown in panels (a)-(b) 
at n = 8192. (d): Histogram showing the distribution of 
number of vertices with in-degree di n = 8 for n = 8192. (e)- 
(f): Degree-distributions of the three models, demonstrating 
scale-free behavior and indicating that ji n = j ou t = 3. Adap- 
tive binning was used, as described in Appendix [C] In all 
cases, both the mean in- and out-degree of each graph are 
2 edges per node. These results demonstrate that £ -1 dif- 
fers significantly for the different graph construction methods, 
while the degree distributions are very similar. 
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Figure 3. (color online) Inverse energy gap scaling for GZL 
[6] copying model (diamonds), and a-preferential attachment 
model [12] (circles) of WWW-like networks, shown on (a): 
Semilog and (b): Log-Log scales. Results are averaged over 
1000 random instances for n < 8192, and over 500 random 
instances at n — 8192. In (a), the line fit shown is 730-ln(n) — 
5300, while in (b) the line fit is 0.2 • n 97 . If we fit the data to 
a power of a logarithm (not shown), for the copying model we 
obtain 3 x 10 -5 • ln 8 '°(n). Because of the large power of the 
logarithm required for the poly logarithmic fit, the power-law 
dependence on n appears more natural and plausible, (c)-(d): 
Degree-distributions of the two models, histogrammed using 
adaptive binning (see Appendix |c|, indicating that — 2.1 
and 7out = 2.72, corresponding to the estimates for the degree 
distribution of the World Wide Web [15]. In all cases, the 
mean in- and out-degree of each network were each 2 edges 
per node. 



nearly identical degree distributions (shown in Figs. [2|e) 
and ^[f)), the scaling of 5~ l depends significantly on 
the method used to construct the graphs when viewed 
in Fig.[2|a). In Fig.[2|c), we show the distribution corre- 
sponding to the final data points in Fig. [2ja) , where we 
see that the distributions are well-separated and hence 
the construction models give different values of J -1 . By 
contrast, the degree distributions are difficult to distin- 
guish, as shown in Fig. [2^d). When viewed in Fig. [2^b) , 
the scaling of 8~ x is similar for all three methods of graph 
construction. The data in Fig. [2] clearly do not scale lin- 
early with log(n). We conclude that the data are more 
consistent with 5~ x scaling either polylogarithmically or 
as a power law, rather than logarithmically. 

We next perform a similar analysis for degree distri- 
butions more closely related to the network of primary 
interest, the World Wide Web, for which a realistic set of 
degree parameters is given by ji n = 2.1 and 7 on ^ = 2.72 



[T5] . As mentioned above, the preferential attachment 
model cannot be tuned to obtain degree parameters other 
than 3. However, the other two network models can be 
adjusted to match these values [9] [12]. More details on 
this are discussed in Appendix [A] As before, we set the 
mean degree to be 2 in- and 2 out-edges per node. 

Fig. [3] presents the results of these simulations, clearly 
indicating that £ _1 scales at least as a power of n. In par- 
ticular, we note that the prefactor of the logarithmic fit 
is over 700 and the power of the logarithm in the polylog- 
arithmic fit is 8, while the power law fit exponent is close 
to one. The results do not change substantially when 
the mean degree is varied and the degree distributions 
exponents are fixed. These data indicate that for graphs 
with degree distributions similar to those measured for 
the World Wide Web, the GZL adiabatic algorithm for 
PageRank vector preparation is unlikely to provide an 
exponential speedup over the classical case. 

Discussion. — We have investigated the recently pro- 
posed adiabatic quantum algorithm for preparing the 
PageRank vector using an adiabatic quantum algorithm 
[6]. We find that the eigenvalue gap that determines the 
algorithm runtime depends on the method of construc- 
tion of the network, even when the feature believed to 
be critical for large-scale network structure, the degree 
distribution, is held fixed. The exponent governing the 
variation of the gap with graph size does not vary signifi- 
cantly with the method of construction only if power-law 
scaling of the gap with size is assumed. For networks that 
are scale- free in their in- and out-degree distributions, 
and particularly when the degree distributions similar to 
those measured for the World Wide Web, our numerical 
results indicate strongly that the GZL adiabatic algo- 
rithm for PageRank vector preparation does not offer an 
exponential speedup over current classical algorithms. 
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also thank the HEP, Condor, and CHTC groups at Uni- 
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Appendix A: Parameters of Web Graph Models 

In implementing the models used in this paper, the re- 
lationship between the parameters of the network genera- 
tion algorithms and the generated networks themselves is 
not always obvious, so in the following section we explain 
it in detail. 



1. GZL Preferential Attachment 

The method of graph construction in the GZL Prefer- 
ential Attachment Model [6] consists of two phases, each 
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with its own parameter. First, a graph X (with adja- 
cency matrix Ax) is created by adding a new vertex at 
each time step, where each vertex is created with mx 
out-going edges. Next, a second graph Y (with adja- 
cency matrix Ay) is created in the same fashion, only 
with each new vertex having my in-coming edges. Ax 
and Ay are then added together, with loops and weights 
discarded, forming the adjacency matrix of the desired 
network, mx and my are the two parameters to con- 
sider in this algorithm. 

In order for a graph to be scale- free, Pr(c^ n = k) and 
Pr(d out = fc), the probabilities that the in-degree d{ n and 
the out-degree d out of a random node have the value fc, 
must satisfy 



Pr(d* n = fc) ~ fc-™ 
Pr(d on£ = fc) ~ 



(Al) 



where ji n and j out are positive real numbers, and it is 
understood that Pr(c^ n = k) = when k < mx and 
PY(d out = k) = when k < my. To compute j in and 
jout: one starts from the undirected version from Ref. 
[19] . This result is then combined with a constant off- 
set, since each vertex of X has m x outgoing edges and 
each vertex of Y has my incoming edges. The resulting 
composite probability distributions follow 



Pr(din = k) 
Pr(d on£ = k) 



(k- 
(*■ 



m x 
m x 



my) 3 , 
my)' 3 . 



(A2) 



Thus, for sufficiently large A:, these distributions are scale- 
free. However, for a large range of intermediate /c, we 
expect substa ntial deviation from the power law depen- 
dence of Eq. (Al). According to GZL [16], the param- 
eters used to generate Fig. 2 in their paper [6], which 
provides the main evidence for logarithmic scaling of the 
gap, follow my ^> mx- In Fig.[4j we show the degree dis- 
tributions for such a network, where we set mx = 1 and 
my = 15. There, we see t hat the degree distributions 
are well-described by Eq. (A2), and that the addition 



process does indeed distort the degree distributions. By 
requiring mx = my , as we have done in this paper (and 
GZL did for a portion of their supplemental material [6]), 
Tin = lout = 3 for all fc, meaning that the in-degrees and 
out-degrees both follow the desired power law behavior. 

The asymptotic (large number of nodes) value of av- 
erage edges per node for the composite graph is also de- 
termined by the parameters mx and my. Because mx 
is the number of out-going edges per vertex in graph X, 
it is also the average number of edges per vertex in X. 
The same logic holds for my and graph Y. Thus, when 
constructing the composite graph, the asymptotic aver- 
age edges per node would be simply mx+rny. Although 
loops are then eliminated from the composite graph, the 
expected number of loops is much less than n in the large- 
n case, so this has little effect on the average edges per 
node. To produce a graph with j in = j out = 3 and aver- 
age in- and out-edges per node of 2 (as in Fig. 2 of the 
main text), we use this model with mx = my = 1. 
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Figure 4. (color online) Degree distributions for the GZL pref- 
erential attachment model with mx — 1 and my = 15, taken 
at graph size n — 8196 and averaged over approximately 1000 
random graph realizations. Both the in-degree (blue circles) 
and out-degree (red squares) distributions are shown. For ref- 
erence, the in-degree distribution for mx — 1 and my — 1 
(duplicated from Fig. [5] of the main text is shown (black dia- 
monds) . The dashed line is the expected power law scali ng; o f 
d -3 , which is applicable for large d. As predicted by Eq. ( A2 ), 
shown as fitting curves, the mx = 1 and my = 15 distribu- 
tions exhibit non-scale-free behavior over a wide region of d. 



2. GZL Copying Model 

The parameters of the GZL Copying Model [6] are sim- 
ilar to the GZL Preferential Attachment, as they both 
involve the adding of two graphs to form a composite 
graph. We again have the parameters mx and my, which 
again indicate the number of out-going edges per node in 
one component graph and the number of in-coming edges 
per node in the other. 

This model has two new parameters, px and py , which 
are the probabilities of a new node connecting to nodes 
chosen uniformly at random at a given time step during 
the construction of X and F, respectively. We follow 
Ref. [14] and add a constant offset (just as in the pref- 
erential attachment case). Doing so, we again obtain the 
result that the graphs are scale- free only for mx = my . 
Assuming this constraint, the composite graph follows 



Px 



lout 



PX 

Py 



l-py 



(A3) 
(A4) 



For the data in Fig. 2 of the main text, we used the 
parameters px = Py = 0.5 and mx = my = 1. In Fig. 
3 of the main text, we used px = 1/11 and py = 35/86 
and mx = vny = 1. 
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3. a-Preferential Attachment 

Just as in the GZL Copying Model, there are multiple 
possible actions at each time step in the ^-Preferential 
Attachment Model [12] , and each of these steps has an 
associated probability, p\ is the probability of adding a 
new vertex with a single out-going edge, P2 is the prob- 
ability of adding a new vertex with a single in-coming 
edge, and 1 — pi — P2 is the probability of an edge being 
added to the existing network without the addition of a 
new vertex, a, the third parameter, measures how far 
the generated network deviates from the GZL preferen- 
tial attachment model. 

As laid out in Ref. [12] , the relationship between these 
3 parameters and the exponents is 



a = 1, and in Fig. 3, we used pi = 0.415, P2 = 0.0851, 
and a = 0.0128. These choices in parameters keep 7^ n 
and j ou t fixed at our desired values, while simultaneously 
keeping the graph at an average of 2 in- and 2 out-edges 
per node. 

Appendix B: Initial Conditions 

For each of these models, it is necessary to specify an 
initial graph to seed the network growth. In our simu- 
lations we used a complete graph (including loops) with 
m + 1 vertices, where m is the number of edges added 
per vertex (in the a-Preferential Attachment Model, we 
used m = 1). 



Tin 
lout 



2 + (pi J cP2)a-P2 

1 ~P2 

2 + (pi J rP2)a-pi 
1-pi 



(A5) 
(A6) 



The connection between these parameters and the av- 
erage number of directed edges per node in the graph is 
clear when one considers that the probability that a new 
node will be added at a given time step is p\ + P2, and a 
new edge is added at each step. 

Using these constraints, we can find appropriate values 
for the parameters for both Fig. 2 and Fig. 3 of the 
main text. In Fig. 2, we used Pi = P2 = 0.25, and 



Appendix C: Adaptive Binning 

In the plots of the degree distributions (Figs. 2(e)-(f), 
Figs. 3(c)-(d), and Fig.[4|, numerical noise caused by few 
high-degree vertices leads to data which are difficult to 
interpret. In order to combat this, we use adaptive bin- 
ning, which functions as follows. First, some sampling 
threshold s t is set, which we take to be 200 in our anal- 
ysis. If a given data point, corresponding to a degree, 
contains at least s t samples, then it is included. If the 
data point instead has fewer than s t samples, it is com- 
bined with nearby points until the aggregated samples 
total at least s t . The weighted average degree and prob- 
ability are then recorded. 
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